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Consider the classic infinite-horizon problem of stopping a one-dimensional diffusion to 
' ^ optimise between running and terminal rewards and suppose we are given a parametrised 

Ph family of such problems. We provide a general theory of parameter dependence in infinite- 

horizon stopping problems for which threshold strategies are optimal. The crux of the 
approach is a supermodularity condition which guarantees that the family of problems is 
indexable by a set valued map which we call the indifference map. This map is a natural 
generalisation of the allocation (Gittins) index, a classical quantity in the theory of dynamic 
allocation. Importantly, the notion of indexability leads to a framework for inverse optimal 
stopping problems. 
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^ 1 Introduction 

(N 

Consider the following classical optimal stopping problem. Given a discount parameter and 
a time- homogeneous diffusion started at a fixed point, we are asked to maximise an expected 
payoff which is the sum of a discounted running reward up until the stopping time and a terminal 
reward depending on the state of the diffusion at the stopping time. We call this problem the 
^ forward optimal stopping problem and the expected payoff under the optimal stopping rule the 

(forward) problem value. 

The problem can be generalised to a parametrised family of reward functions to give a 
parametrised family of forward problems. This generalisation is often natural. For instance, 
in economics we may be interested in the effect of changes in a dividend or a tax rate on the 
value of an investment and the optimal investment decision. In dynamic resource allocation 
problems, a parameter may act an index for different projects. In this context, the decision of 
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which project to engage requires an analysis of the parameter dependence of optimal stopping 
rules and problem values. 

The approach to solving forward problems in this article is motivated by previous work for 
the case when there is no running reward. In the case of perpetual American puts, Ekstrom 
and Hobson [12] establish convex duality relations between value functions and the Laplace 
transform of first hitting times of the underlying diffusion. In related work by Lu [21] , the 
approach is developed to establish duality when the parameter space is a discrete set of strikes. 
More generally, Hobson and Klimmek [T7] employ generalized convex analysis to establish dual- 
ity between log-transformed value functions and log-transformed diffusion eigenfunctions for a 
general class of reward functions. The common strand in this previous work on inverse stopping 
problems is the conversion of a stochastic problem into a deterministic duality relation involving 
monotone optimizers. 

This article provides a unifying view of the monotone comparative statics results for optimal 
stopping developed previously and an extension to non-zero running rewards. We show that a 
supermodularity condition on the reward functions guarantees monotonicity of optimal thresh- 
olds in the parameter value. This monotonicity of the thresholds imposes a useful and natural 
order on families of parametrised stopping problems through a generalisation of the so-called 
allocation (or Gittins) index, an important quantity in the theory of dynamic allocation prob- 
lems (see for instance Whittle |28j and Karatzas [19] ). We utilise the notion of indexability to 
solve parametrised families of stopping problems. 

As well as solving families of forward problems, we consider the problem of recovering dif- 
fusion processes consistent with given optimal stopping values. 'Inverse optimal stopping prob- 
lems' find natural motivation in mathematical finance and economics. When there is no running 
reward, the problem has the interpretation of constructing models for an asset price process 
consistent with given perpetual American option prices. Now suppose instead that we are given 
an investor's valuation for a dividend bearing stock which may be liquidated for taxed capital 
gains. Given the valuation, we would like to recover the investor's model. Similar situations 
may arise in a real-options setup. A bidder for a resource extraction project may submit a 
range of bids for a project depending on an economic parameter. In this case, a regulator might 
naturally be interested in recovering the investor's model which underlies the bids. This article 
provides solutions to inverse problems in the presence of a non-zero running reward (or cost). 
We show that the value function does not contain enough information to recover a diffusion and 
that solutions to the inverse problem are parametrised by a choice of indifference (allocation) 
index. The indifference index can be interpreted as representing an investor's preferences with 
respect to remaining invested or liquidating. Given consistent preferences and valuations, it is 
possible to recover a diffusion model. 

This article provides a direct approach to forward and inverse problems based on principles 
from monotone comparative statics and dynamic allocation. In spirit, the direct approach is 
related to recent seminal work by Dayanik and Karatzas [11] and Bank and Baumgarten [3]. 
The direct solution method in [11] . based on the calculation of concave envelopes, is employed 
by Bank and Baumgarten [3j to solve parameter-dependent forward problems. However, the 
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method used in [3] is restricted to problems with linear parameter dependence and requires 
calculation of an auxiliary function which transforms general two-sided stopping problems to 
one-sided threshold problems. The approach taken in this article is to focus on optimal stopping 
problems for which one-sided threshold strategies are optimal. This restriction (which is usual in 
the setting of dynamic allocation problems) leads to a tractable characterization of parameter- 
dependence. As an analysis of allocation indices and stopping problems, this article can be seen 
to extend the work of Karatzas |19j . However, the aim here is not to prove the optimality of 
the 'play-the-leader' policy for multi-armed bandits, but to generalise the approach to inverse 
optimal stopping problems introduced in [17J. The fundamental aim is to establish qualitative 
principles that govern the relationship between data (e.g. prices), economic behaviour (e.g. 
investment indifference levels) and models (e.g. generalised diffusions). 



2 Forward and the inverse problems 



Let X = [Xt)t>o be a diffusion process on an interval /, let p be a discount parameter. Let 
G = {G(x, 9);9 £ 0} be a family of terminal reward functions and c = {c(x, 9); 9 G B} a family 
of running reward functions, both parametrised by a real parameter 9 lying in an interval 
with end-points 6L and 9 + . The classical approach in optimal stopping problems is to fix the 
parameter, i.e. © = {9}, and calculate 



V(x) = supEa 



Jo 



e~ pt c{X u 9)dt + e~ pT G{X T 



for x G int(J) using variational techniques, see for instance Bensoussan and Lions [5]. 

In contrast, we are interested in the case when the starting value is fixed and the parameter 
varies. Then the forward problem is to calculate V = {V{9) ; 9 G 0} where 



V(9) = su P Ex 



e- pt c(X u 9)dt + e- pT G(X T ,i 



(2.1) 



We will assume that the process underlying the stopping problem is a regular one-dimensional 
diffusion processes characterised by a speed measure and a strictly increasing and continuous 
scale function. Such diffusions are 'generalised' because the speed measure need not have a 
density. 

Let I C M be a finite or infinite interval with a left endpoint a and right endpoint b. Let 
m be a non- negative, non-zero Borel measure on IR with / = supp(m). Let s : I — > M be a 
strictly increasing and continuous function. Let xq G I and let B = (Bt)t>o be a Brownian 
motion started at Bq = s(xo) supported on a filtration ¥ B = {T B )u>o with local time process 
\L Z U \ u > 0, z G M}. Define T to be the continuous, increasing, additive functional 



L z u m(dz) 



and define its right-continuous inverse by 

A t = inf{n : T u > t}. 



3 



If Xt = s 1 {B(Atj) then X = (Xt)t>0 is a one-dimensional regular diffusion started at xq with 
speed measure m and scale function s. Moreover, Xt £ I almost surely for all t > 0. 
Let H x = inf{« : X u = x}. Then for a fixed p > (see e.g. [25]). 



£(*,y)=E,[e-^] = <! W : (2.2) 




where 99 and (/> are respectively a strictly increasing and a strictly decreasing solution to the 
differential equation 

1 ^ L ^f = Pf- (2-3) 
2 dm as 

In the smooth case, when m has a density ^ so that m(dx) = v(x)dx and s" is continuous, (2.3) 
is equivalent to 

\o\x)f (x) + a(x)f'(x) = pf(x), (2.4) 

where 

u(x) = o~ 2 {x)e M{ - x \ s'{x) = e~ M{x \ M{x) = f ' 2a~< \z)a(z)dz . 



We will call the solutions to (2.3) the A-eigenfunctions of the diffusion. For a fixed diffusion 
with a fixed starting point we will scale (p and 4> so that i -p{Xq) = 4>(Xq) = 1. The boundary 
conditions of the differential equation (2.3) depend on whether the end-points of / are inacces- 
sible, absorbing or reflecting, see Borodin and Salminen [7] for details. We will denote by int(/) 
the interior of / and its accessible boundary points and we will make the following assumption 
about the boundary behaviour of X. 

Assumption 2.1. Either the boundary of / is non-reflecting (absorbing or killing) or X is 
started at a reflecting end-point and the other end-point is non-reflecting. 



Now, for flee, let 



R(x,9) = E 2 



/ e~P t c(X t ,e)dt 
Jo 



(2.5) 



Define U : IxO ->■ K by U(x, 6) = G(x,6)-R(x,6) and for all 9 G and x G I let c e (x) = c(x,6) 
and R e (x) = R(x,6). 

Assumption 2.2. Ex [J °° e~ ps \c e (X s )\ds\ < 00 for all x G int(I) and 6 G 0. 

Under our assumptions it is well-known (see for instance Alvarez [2]) that R 8 : int(7) — > M. 
solves the differential equation 

Example 2.3. In some cases R e can be calculated directly. Let p < p and let dXt = aXfdBt + 
pX t dt and c(x, 9) = x9. Then E x [J °° e~ pt X t 9dt\ dt = x9 J °° e^'P^dt = 

Example 2.4. Suppose m{dx) = 2x 2 dx and s(x) = —1/x. Then X is known as the three- 
dimensional Bessel process and solves the SDE; dXt = dBt + dt/Xf. Let c : M? — > M. be defined 
c(x,9) = #cos(x) and p = 1/2. Then R 9 solves \f"(x) + f'(x)/x — \ f{x) = —9cos(x) with 
/(0) = 0. The solution is R e {x) = 9 (cos(x) - 
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In order to rule out the case of negative value functions we also make the following assump- 
tion. 



Assumption 2.5. For all 9 G 0, x — > U(x, 9) there exists x G int(I) such that U(x, 9) > 0. 
2.1 Summary of the main results 

Our main result for the forward problem can be summarised as follows. 

Solution to the forward problem: Given a generalised diffusion X, ifU(x, 9) = G(x, 9) — 
R(x,9) is log- supermodular then a threshold strategy is optimal on an interval (9-,9r) and an 
optimal finite stopping rule does not exist for 9 > 9r. Furthermore, if U is sufficiently regular 
and V is differentiate at 9 £ (9-,9r) then 

Uo(x*(9),e) 

where x* : G —> I is a monotone increasing function such that r = H x *ng\ is the optimal stopping 
rule. 

Now suppose that we are given V = {V(6) ; 9 G 6} and G = {G(x,9) ; x G R, 9 G G}, 
c = {c(x) ; x G M} and Xq. Then the inverse problem is to construct a diffusion X such 
that Vx = V is the value function corresponding to an optimal threshold strategy. (To keep 
the inverse problem tractable we focus on the case when the running cost is not parameter 
dependent.) Our analysis hinges on specifying the parameters for which it is optimal to stop 
immediately (i.e. r = 0) for a given level of the underlying diffusion. If we consider V to be the 
value of an investment as a function of a parameter (e.g. a level of capital gains tax), then the 
indifference map specifies the parameters for which an investor would be indifferent whether to 
invest or not as it would be optimal to sell immediately. 

The indifference map is a natural extension of the allocation (Gittins) index which occurs 
naturally in the theory of multi-armed bandits. We provide a novel application of this classical 
quantity in the context of inverse investment problems and real option theory. The indifference 
map can be seen to represent investor preferences with respect to liquidating for capital gains 
or remaining invested for future returns. Depending on the valuation of an investment as a 
function of the parameter, we will show how to recover diffusion models for the underlying risky 
asset consistent with given preferences (indifference maps). 

Solution to the inverse problem: Solutions to the inverse problem are parametrised by 
a choice of allocation index 9* : I — > G: The functions ip and R defined 



determine the speed measure and scale function of the solution through equations (2.3) and 
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3 The forward problem: threshold strategies 



Threshold strategies are a natural class of candidates for the optimal stopping time in the for- 
ward problem. Our first aim is to establish necessary and sufficient conditions for the optimality 
of a threshold strategy. 

By the strong Markov property of one-dimensional diffusions the value function for the 
optimal stopping problem can be decomposed into the reward from running the diffusion forever 
and an early stopping reward. 

V(x, 9) = R(x, 9) + supE x [e- pT (G(X T , 9) - R(X T , 9))]. (3.1) 

T 

We will let E(x, 9) = V(x, 9)—R(x, 9) denote the optimal early stopping reward and let U (x, 9) = 
G(x, 9) — R(x, 9) denote the early stopping reward function. 

Lemma 3.1. Stopping at the first hitting time of z > Xq, z £ int(/) is optimal if and only if 
attains its global maximum on int(I) at z. 

Proof. Suppose that the global maximum is achieved at z > Xq. Let 

U(z,9) 



E{9) 



<p(z) 



We will show that E(Xq,9) = E{9). On the one hand, E(Xq,9) > E(9) since the supremum 
over all stopping times is larger than the value of stopping upon hitting a given threshold. 
Moreover e~ pt (p(Xt) is a non-negative local martingale hence a super- martingale. We have that 
for all stopping times r, 



1 > Ex [e-P T <p{X T )] > Ex 



e- pT 



U(X T ,t 
E{9) 



and hence E{9) > Ex [e pT (G(X T , 9) — R(X T , 9))] for all stopping times r. Hence H z is optimal. 

For the converse, suppose that there exists an z' £ int(I), z' / z such that U ^f^ > U !p{z) • 
We will show that there exists a stopping time which is better than H z . First, if z' > Xq then 
stopping at r = H z i is a better strategy than stopping at r = H z . Now suppose z' < Xq. Then 

U(z,9)E Xa [e~ pHz ] = U(z,9)Ex le- pH n Hz<H J + U(z,9)Ex le~ pH z'lH z ,<H z }EAe- pH *} 

= U(z,9)Ex [e- pH n Hz<Hzl ] + U(z',9)Ex [e- pH ^lH zl <H z ]§^^ 
< U(z,9)Ex [e- pH n Hz<H J + U(z',9)Ex [e~ pH *'l Hz ,<H z }, 

so stopping at H( z \ z ) is better than stopping at H z . □ 

Remark 3.2. There is a parallel result for stopping at a threshold below Xq. A threshold below 
Xq is optimal if and only if U- attains a global maximum below Xq. 
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Example 3.3. Recall Example 2.3 and let X be a Geometric Brownian Motion started at 1 with 
volatility parameter a and drift parameter \i < p. Suppose G = M + , G{9) = 9 and c(x, 9) = x. 
Then U(x,9) = G(x,6) — R(x,9) = 9 — x/(p — p). U(x,9) is decreasing so we look for a 
stopping threshold below 1. 4>{x) = x ~^/ u2jr2p / a2 ~ v for < x < 1, where v = p/a 2 — 1/2. Let 
c_ = ^Jv 2 + 2p/o~ 2 + v and x(9) = c ~^~^ ■ If < x{9) < 1 then x{9) is the optimal stopping 
threshold. If x(9) = then it is optimal to 'wait forever'. If x{9) > 1 then it is optimal to stop 
immediately. 

The following Lemma shows that if a threshold strategy is optimal then the optimal threshold 
is either above or below the starting point. This rules out the case that both an upper threshold 
and a lower threshold are optimal for a fixed parameter. 

Lemma 3.4. For a fixed parameter 9 , letU(s) = U(s,9). Let A_ = {z : z £ argmax s [U (s) / (p(s)}} 
and A_|_ = {z : z £ argmax s [U(s)/ip(s)]} . If x £ A + and y £ A_ then x < y. 



Proof. Suppose that y < x. It follows that 

<p(y) G(y,9)/<P(y) 



> 



G(x,9)/<f>(x) <p(x) 



<Ky) G(y,0)/<p(y) G(x,0)/<p(x) 
contradicting the fact that % is strictly increasing. 



0(x)' 



□ 



Example 3.5. Let X be Brownian Motion on [0, 2tt] killed at and at 2ir. Let c = and 
= M + and G(x,9) = 9\ sinh(x sin(x)) | and suppose p = 1/2. Then (f(x) = sinh(x) and 
4>(x) = sinh(27r — x). Now fix 9 = 1 and define A + and A_ as in Lemma 3.4 > We calculate 
A + = {tt/2,3tt/2} and A_ ~ {5.14}. If Xq lies to the left (right) of an element in A + (A_) 
then an upper (lower) threshold is optimal. If Xq lies between the largest element in A + and 
the smallest element in A_ then a threshold strategy is not optimal. 



U/<p 



A 5 A 



u 



Figure 1: Picture for 9 = 1. % is represented by the dashed line and A_ is a singleton, 
is represented by the solid line and A + consists of two points. There is no optimal threshold 
strategy if Xq lies in the shaded region. 



In general, given a family of forward problems over an interval G, we may find that threshold 
stopping is optimal on the whole interval Q, on a subset of G or nowhere on G. We will 
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temporarily assume that the forward problem (2.1) is such that a threshold strategy is optimal 
on the whole parameter space. Later, in Section 3.2 we will see how to relax the assumption. 



Assumption 3.6. For all 6 6 it is optimal to stop at a threshold above Xq. 

There is, as will always be the case, a parallel theory when the optimal thresholds are below 
Xq, compare Remark |3.2| 



3.1 The envelope theorem 

We will now derive our main result for the parameter dependence of the value function through 

an envelope theorem. The aim is to derive an expression for the derivative of V. 

\U(x, 6)1 

For a fixed parameter 6 let X*{6) = argmax a . gint ^) — ' . Then X*(6) is the set of 

possible threshold strategies for a fixed parameter 6. We will let X*(@) denote the collection 
of all threshold strategies for the parameter space. Letting x + = sup{x : x £ X*(Q)}, we 
have that X*(Q) C Recall the definition of the early stopping reward. We abuse the 

notation slightly by setting E{6) = V(Xq, 6) — R(Xq, 6), making the dependence on the starting 
value implicit. Let us also set r](6) = log(E(9)). The following Proposition follows from an 
envelope theorem, see Corollary 4 in Segal and Milgrom, |22j. 

Proposition 3.7. If [Xq,x + ] C int(J), U(x,6) is upper- semicontinuous in x and Uq{x,9) 
is continuous on [Xq,x + ] x then V is lipschitz continuous on 6+) and the one-sided 
derivatives are given by 

U e (x(6),6) 



E'( 



mm 



U e (x(6),6) 



E'{6+) = max . 

x{0)ex*{6) ip(x(0)) 

E is differentiate at 8 if and only if |^^rp : x{6) £ X*(6)j is a singleton. In particular we 
then have 

±r ] (6) = u e (x(8),6), (3.2) 
forx(6) G X*{6) where u(x,6) = log(U(x,6)). 



Remark 3.8. Equation (3.2 ) follows by combining the equations E'{6) = ^$0p~ ( a consequence 



3.1). 



of the envelope theorem in Milgrom [22]) and E{8) = U ^^l^ (Lemma 

Remark 3.9. The condition [Xo,x+] C int(J) is satisfied if the boundary points of I are acces- 
sible. 

Corollary 3.10. If the conditions in Proposition 3.1 are satisfied then for any 9, 9' E 0, 

where x(s) is a selection from X*(s). 



8 



Corollary 3.11. Suppose G(x,9) = G{9) is continuously differentiable and c(x,9) = c{x). If 
V is differentiable at 9 then 

V'(8) = G'(e)Ex [e~ pH ^}, 

forx(8) e X*{9). 



Example 3.12. In Example\ 3.3\ if [i < p 

V'(9) - 



c_+l J U < U < (p-M)c- 

1 8> 1+c " 



(p-n)c- 

Parameter dependence of stopping problems is a common theme in the literature on multi- 
armed bandits in which a special case of the general forward problem, which we will call the 
standard problem, is studied. 



Definition 3.13. If G(x,9) = G{9) and c(x,6) = c(x) then the problem forward problem (2.1) 
is called the standard (forward) problem. 



The preceding Corollary 3.11 is the analogue in a diffusion setting of Lemma 2 in Whittle [28] . 
As in [28] our setup allows for points of non-differentiability and for the possibility of multiple 
optimal thresholds above the starting point. In contrast, existing results in the diffusion setting, 
see for instance Karatzas [19] (Lemma 4.1) make strong assumptions on the diffusion and on 
c which ensure that X*(9) is single valued and that the value function is differentiable in the 
parameter. 

In general, the optimal stopping thresholds for a parameter are given by a set-valued map 
X* : — > I. We will now define the inverse map from the domain of the diffusion to the 
parameter space. 

Definition 3.14. Q*(x), the indifference map at x, is the set of parameters 9 £ for which it 
is optimal to stop immediately when Xq = x. 

Remark 3.15. Under additional assumptions the indifference map can be represented as a mono- 



tone function, see Corollary 4.9 



The indifference map 0* is a natural generalisation of the allocation index common in 
the theory of multi-armed bandits: while we make few assumptions on the reward functions, 
the multi-armed bandit or dynamic allocation literature is restricted to the standard problem 
(c(x,9) = c(x) and G(x,9) = 9), see for instance Gittins and Glazebrook [H], Whittle [28] and 
for a diffusion setting closer to the setting of this article, Karatzas [19] and Alvarez [2]. 

The following example illustrates our approach to parameter dependent stopping problems 
and the idea of calculating critical parameter values. Although we focus on the case when the 
forward problem is indexed by a single parameter, the analysis of forward problems parametrised 
by several parameters is analogous. 
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Example 3.16. A toy model for tax effects Suppose X is a model for the profits of a firm: 
Xt = crBt + xq, where B is a standard Brownian Motion and a > 0. In a tax-free environment 
a model for the value V of the firm is 



V(p,5,a) = supExo 



e'^Xtdt + e~ pT 5 



o 



where 5 is the salvage value of the firm. U(x,S) = 5 — x/p is decreasing in x and we look for 
an optimal stopping threshold below Xq. We have <fi(x) = e -V^P x / a and R(x) = ~. Let x\ be 
the optimal threshold (investment decision) in the tax-free environment above. We calculate 
x i = x * G° ; 8,a) = mm{5p - ^ , X } . 

Now consider what happens to the value of the firm if profits are taxed. Suppose that profits 
are taxed at a rate 9, and that the tax-base at time t is Xt — d, where d represents a tax- 
deductible depreciation expense (or some other adjustment to th e tax base). The post-tax profit 



of the firm is Yt = Xt — 9{Xt — d). The decreasing solution to (2.4) is <p Y (x) = exp ( (jz^gj^ J 
while R Y (x) = R((l — 0)x + Od) = ( 1 ~ 9 ) x+ed _ The optimal threshold (x 2 ) for the after-tax 
investment problem is 

*r a (pS-ed a(l-9) v 
x 2 {d,p,m,a,d) = mini — 7 =^,X< i 



1-0 jTp 

In taxation theory, a tax-rate is neutral if it does not change investment decisions. It is 
sometimes considered desirable for taxes to be neutral, see for instance Samuelson \2ty . Let 9m 
denote the neutral tax rate in this problem. To compute On we solve x*(p, 5, a) = x* 2 {9n-, P, 5, cr, d) 
for Ox, to find 

1 - N (p,5,a,d) = ^/2p . 

Finally we check that 9n € (0, 1) if and only ifO < d — 5p < a/y/2p. Similarly, given a tax rate 
9 we could calculate the depreciation adjustment d*(p,5,a,9) so that the investment decision 
is unchanged, which is the idea in Samuelson I26\j . See also Klimmek 120)/ for analysis of the 
relationship between tax levels, risk preferences and decisions under uncertainty. 



In Example 3.16 the optimal thresholds are monotone in one or more of the parameters. In 



the next section we will derive natural conditions for the monotonicity of threshold strategies 



X*. We will see that if X* is monotone then we can relax Assumption 3.6 



3.2 Monotonicity of the optimal stopping threshold in the parameter value 

We will say that X* is increasing (decreasing) if x G X*(9) and x' G X*(9') with 9 < 9' implies 
x < (>)x'. 

Definition 3.17. 

i) A function / : M 2 — > R is supermodular in (y,z) if for all y' > y, f(y',z) — f(y,z) is 
increasing in z and if for all z' > z, f(y, z') — f(y, z) is increasing in y. Equivalently, / is 
supermodular if /(max{y', y}, max-{V, z}) + /(min{y', y}, min-JV, z}) > f(y, z) + f(y', z') 
for all (y, z). 
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ii) If the inequalities in i) are strict then / is called strictly supermodular 

hi) If — / is (strictly) supermodular, / is called (strictly) submodular. 

iv) / is (strictly) log-supermodular if log(/) is (strictly) supermodular. 

Remark 3.18. Note that if / is twice differentiable then / is supermodular in (y, z) if and only 
if f yz (y, z) > for all y and z. 

The next Lemma follows from a straightforward application of standard techniques in mono- 
tone comparative statics to the setting of optimal stopping, see for instance Athey [3]. 

Lemma 3.19. Suppose that U(x,9) = G(x,6) - R(x,9) > on int(I) x 6. If U is log- 
supermodular then X* is increasing in 9. 



3.6 



Define a 



Proof. Suppose that 9 > 9. X*{9) and X*{9) are non-empty by Assumption 
function / via f(x,9) = u(x,9) — ip(x), where ip(x) = log((p(x)) (recall the definition of <p, 
(2.2)). Then / is also supermodular. Now for any x(9) € X*(9) and x(9) € X*{9) we have 

> /(max{x(0), a;(0)}, 9) - f{x{9), 9) > f{x{9), 9) - f(mm{x(9),x(9)}, 9) > 0. 

The first inequality follows by definition of X*(9) the second by supermodularity and the last 
inequality by definition of X*(9). Hence there is equality throughout and max{x(9),x(9)} £ 
X*(9) and min{x(<9), x{6)} £ X*(6). It follows that X*(9) is increasing in 9. □ 

Corollary 3.20. If U is log- submodular then X*{9) is decreasing in 9. 

Remark 3.21. It may be the case that U(x,9) takes both strictly positive and negative values 
on int(I) x 0. In this case it is never optimal to stop at x' if U{x' , 9) < and so we need only 
check supermodularity on the set {(x,9) : U(x,9) > 0)}. 

Monotonicity of the optimal stopping threshold will play a crucial role in our analysis of 
inverse optimal stopping problems because it leads to the notion of indexability. We will say 
that a stopping problem is indexable if X* is monotone. 

The notion of indexability is vital in dynamic allocation theory, leading to the natural heuris- 
tic of operating the project with the highest allocation index, i.e. 'playing-the- leader'. Most 
recently, Glazebrook et al. [15] have generalised the notion of indexability to a large class of 
resource allocation problems. We note, however, that the definition of indexability presented 
here does not arise out of a Lagrangian relaxation of an original problem involving only a run- 
ning reward as is the case in [15]. Instead, in the context of a optimal stopping problems, 
indexability is a natural feature in the monotone comparative statics of parametrised families 
of forward problems. 

The following assumption will ensure that X* is increasing. There will be a parallel set of 
results when X* is decreasing. 

Assumption 3.22. U(x,9) > and log(C/) is supermodular. 
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Example 3.23. Recall Example 2.4 ■ Let X be a three-dimensional Bessel process started at 
1, p = 1/2, c(x,6) = 9 cos(x) and G = 0. We have (p(x) = ^g^n^ • -/Voie i/iai c(x,9) is both 
log- supermodular and log- submodular. Suppose 9 > 0. attains its maximum at x where 

x ~ 2 is t/ie smallest solution to the equation coth(x)(xcos(a;)— sin(x))+xsin(x) = 0. For# < 0, 
i/te maximum is attained at the second smallest root of the same equation and x ~ 5.4. Hence 




Figure 2: ^fe^ for 6* = 1 (solid line) and = — 1 (dashed line). 



we /md i/ia£ X*(#) is decreasing. This does not contradict Lemma 3.25 because Assumption 



3.22 is violated: The set of points where —R(x, 9) is positive when 9 > and stopping is feasible 
coincides with the set of points where —R(x, 8) is negative (and stopping is therefore not feasible) 



when 9 < 0. Compare Remark 3.21 



In general, if we remove Assumption 3.6, a threshold strategy may never be optimal or it 
may only be optimal on some subset of parameters in 0. In the following we will show that 
if U(x, 9) is log-supermodular then a threshold strategy will be optimal for all parameters in a 
sub- interval of 0. 

Let 9 R be the infimum of those values in for which X*(9) = 0. If X*(0) = for all 9 e Q 
then we set 0r = 9-. 

Lemma 3.24. The set of 9 G where X*(9) is non-empty (threshold stopping is optimal) 
forms an interval with end-points and 9r. 



Proof. Let g denote the right end-point of /. Suppose X*{9) ^ and 9 £ 
that X*(9) /0. 

Fix x G X*(9). Then E{X , 9) = u(x, 9) - ip(x) and 



We claim 



u(x, 8) — tp(x) > u(x, 9) — ip(x), 



(3.3) 



and for x = g if g G int(/). We write the remainder of the proof as if we are in the case 
g G int(J); the case when g ^ int(7) involves replacing x < g with x < g. 
Fix 9 < 9. We want to show 



u(x, 9) — ip(x) > u(x, 9) — i()(x), 



Vx G (x, g], 



(3.4) 
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for then 



sup{u(rc, 9) — tp(x)} = sup{u(x, 9) — tp(x)}, 




and since u(x,0) — ip( x ) is continuous in x the supremum is attained. 
Since u is supermodular by assumption we have for x S (x, g] 



u(x, 9) — 



u(x, 9) < u(x, 9) — u(x, 9). 



(3.5) 



Subtracting (3.5) from (3.3) gives ( |3.4[ ). 



□ 



In the standard case, determining whether u(x,9) = \og(G(x,9) — R(x,9)) is supermodular 
is simplified by the following result. 

Lemma 3.25. Suppose that the boundary points of X are inaccessible. 

If G = then X*(9) is increasing in 9 if and only if —c(x, 9) is log- supermodular. 

In the standard case G(9)—R(x) is log- supermodular if and only ifQ(x, 9) is log- supermodular 
where Q : I x 6 -> M, Q(x, 9) = pG{9) - c(x). 

Proof. Athey [3] and Jewitt [18] prove that / : M 2 — > R + and h : M? — > M + are log-supermodular 
if and only if J s f(x, s)h(s, 9)ds is log-supermodular. The first statement now follows from the 
fact (e.g Alvarez [2j or Rogers [23], V.50) that R(x,9) = f I r(x,y)c(y,8)m{dy), where r(x,y) is 
a product of two single-variate functions and hence log-supermodular. 

For the second statement note that E x [/ °° e- pt (pG(9) - c(X t ))dt] = G(9) - R(x). By the 
result of Athey and Jewitt, G(9) — R(x) is log-supermodular if and only if Q(x,9) is log- 
supermodular. □ 

4 Inverse optimal stopping problems 

In this section our aim is to recover diffusions consistent with a given value function for a 
stopping problem. We recall that when c = and G(x,9) = (9 — x) + , the problem has 
the interpretation of recovering price-processes consistent with perpetual American put option 
prices. Consider instead a situation in which an investor is considering whether to invest in a 
dividend bearing stock that can be liquidated at any time for capital gains. The capital gains 
depend on a parameter, e.g. a tax or subsidy rate. In this context, the indifference index has 
the natural interpretation of the parameter level (s) at which the investor is indifferent about 
the stock: at the critical level, the optimal policy would be to sell the stock immediately hence 
there is no expected gain from investment. The question that we ask in this section is whether 
we can recover an investor's model for the asset price process given his valuation and investment 
indifference levels for the parameter. 

The problem of recovering investor preferences from given information is a natural problem 
in economics and finance. In economics, the question of recovering information about an agent's 
preferences given their behaviour dates back to Samuelson's work [27] on revealed preferences. 
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Work on inverse investment problems includes Black [6] , Cox and Leland [10] , He and Huang |16j 
and most recently Cox et al. [9]. Rather than calculating an optimal consumption/portfolio 
policy for a given agent (with a given utility function), the literature in this area aims at 
recovering utility functions consistent with given consumption and portfolio choices. These 
'inverse Merton problems' have three fundamental aspects. The first is the specification of a 
model for an agents' wealth process. The dynamics of the model are given by a dynamic budget 
constraint and are fully determined given an agent's consumption and investment policy. The 
second fundamental aspect is an assumption on how the agent values the wealth developing out 
of his investment and consumption activity. It is assumed that he maximises utility. The third 
aspect, which is the crux of inverse Merton problems, is to determine the agents' utility, or gain 
functions given the wealth dynamics and assuming the agent is utility maximising. 

As in the inverse Merton problem, three fundamental quantities emerge in the study of the 
inverse perpetual optimal stopping problems considered here. 1) A model for the underlying 
random process, 2) valuation of the investment and 3) investor preferences (indifference levels). 
As we will see below, if we are given only an agent's valuation then the inverse problem is 
ill-posed. There will then in general be infinitely many models solving the inverse problem, 
each corresponding to a choice of indifference index. As in the inverse Merton problems where 
both a model for the wealth process and the assumption of valuation via utility maximisation 
are given, we require two of the three pieces of information inherent to the perpetual-horizon 
investment problem to construct a solution: given a value function and (admissible) investor 
indifference levels, a consistent model is uniquely specified on the domain of the indifference 
index. 

4.1 Setup 

As before, let O be an interval with end-points 9- and 9 + . Let us assume that we are given 
V = {V{9) ; 9 G 0}, G = {G(x,9) ; i£R, 9 e 6}, c = {c(x) ; i£l) and X . 

Inverse Problem: Find a generalised diffusion X such that Vx = V is consistent with one- 
sided stopping above Xq. 

Remark 4.1. In developing the theory we focus on threshold strategies above Xq. There is, as 
ever, an analogous inverse problem for threshold strategies below Xq. See for instance Example 

We will make the following regularity assumption. 

Assumption 4.2. V : — > R is differentiable and (x,9) — > G(x,9) is twice continuously 
differentiable. 

As in Hobson and Klimmek |17j , we will use generalized convex analysis of the log-transformed 
stopping problem to solve the inverse problem. 
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4.2 u-convex Analysis 

Definition 4.3. Let A, B be subsets of R and let u : A x 5 — > R be a bivariate function. The 
u-convex dual of a function / : A — > B is denoted f u and defined to be f u (z) = sup yeA [u(y, z) — 

/(»)]■ 

Definition 4.4. A function / is u-convex if = (/")" = /. 
Definition 4.5. The u-subdifferential of / at y is defined by 

d u f(y) = {zGB: f(y) + f u {z) = u(y, z)}, 

or equivalently 

d u f(y) = {zeB: u(y, z) - f(y) > u(y, z) - f(y),\fy £ A}. 

If 5 is a subset of j4 then we define d u f(S) to be the union of u-subdifferentials of / over all 
points in S. 

Definition 4.6. / is u-subdifferentiable at y if d u f(y) ^ 0. / is u-subdifferentiable on S if it 
is u-subdifferentiable for all y £ S, and / is u-subdifferentiable if it is w-subdifferentiable on A. 

The following envelope-theorem from u-convex analysis will be fundamental in establishing 
duality between the value function and the log-transformed eigenfunctions of consistent diffu- 
sions. The idea, which goes back to Riischendorf [24] (Equation 73), is to match the gradients 
of u(y, z) and u-convex functions f(y), whenever z £ d u f(y). The approach was also developed 
in Gangbo and McCann |13j and for applications in Economics by Carlier [Sj. We refer to [H] 
for a proof of the following result. 

Proposition 4.7. Suppose that u is strictly supermodular and twice continuously differentiable. 

If f is a.e differentiable and u-subdifferentiable. Then there exists a map z* : D y — > D z such 
that if f is differentiable at y then f{y) = u(y,z*(y)) — f u {z*{y)) and 

f(y) = u y (y,z*(y)). (4.1) 
Moreover, z* is such that z*(y) is non- decreasing. 

Conversely, suppose that f is a.e differentiable and equal to the integral of its derivative. If 
holds for a non- decreasing function z*(y), then f is u-convex and u-subdifferentiable with 
f(y)=u(y,z*(y))-r(z*(y)). 



Remark 4.8. If u is strictly log-submodular the conclusion of Proposition 4.7 remains true, 
except that z*{y) and y*(z) are non-increasing. 

The subdifferential d u f may be an interval in which case z*{y) may be taken to be any 
element in that interval. By Lemma 3.19, z*(y) is non-decreasing. We observe that since 
u(y,z*(y)) = f(y) + f u (z*(y)) we have u(y*{z),z) = f(y*(z)) + /(*) and y*(z) G d u f u {z) so 
that y* may be defined directly as an element of d u f u . If z* is strictly increasing then y* is just 
the inverse of z* . 
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4.3 Application of w-convex Analysis to the Inverse Problem 



We introduce the notation that we will use for our inverse stopping problem framework. The 
main change over the previous section is that we will highlight dependence on the (unknown) 
speed measure m and scale function s. 

We wish to recover a speed measure m and scale function s to construct a diffusion X m,s = 
(X t ' s )f>Q, supported on a domain I m C R such that Vx™, 3 = V. Our approach to solving 
this problem is to recover solutions (p m ,s and R m ,s to the differential equations (2.3) and (2.6) 



from V and to solve the two equations 'in reverse' to recover the speed measure and the scale 



function. Let if) m , 8 = log((f m ,s), where ip m ,s is the increasing solution to (2.3) with ip m:S (Xo) = 1 
and let R m ,s{x) = Ex[/ °° e~ pt c{X^ l)S )dt\. We will say that functions R m ,s, <fm,s, X*, etc. are 
consistent with the inverse problem if there exists a diffusion X m,s such that Vx m . s = V. Our 
approach involves establishing Vm,s and rj mjS {0) = \og{V{0) — i? mjS (Xo)) as u mjS -convex dual 
functions, where u m>s (x, theta) = log(G(x, 0) — R m)S (x)). Denote the ii mjS -convex duals of tpm,s 
and r] m ,s by ipl^ s and t?^ s respectively. 

The solution to the inverse problem hinges on Proposition |4.7| Let us briefly highlight 



the connection between Proposition |4.7| and Proposition |3.7[ Suppose V = Vx m , s and that 
u m>s (x, 0) is strictly log-supermodular and twice continuously differentiable. Then rj m ^ s {0) is 
u mjS -convex with u mjS -subdifferential X* , i.e. r] m ^ s {0) = sv^> x&nt ^ m ^[u mtS {x,0) - ip m)S (x)] = 
Um,s{x*{0), 0) — ifim,s(x* (0)) , for some optimal stopping threshold x*{0) G X*{0). Hence by 
Proposition |4.7[ we have 

V'{0) G e (x*{0)) 



V{0) - RmA x o) G(x*(0),0) - R m , s (x*(0)) ' 
Substituting for (p myS (x* (9)) we find 

G e (x*(9),0) 



V'{0) 



¥rn,s{x* (0)) 



which is the expression in Proposition 3.7 when V is differentiable. 

In the following, whenever u m ^ is strictly supermodular and Vx m > a = V we will let x* denote 
the non-decreasing function satisfying rf m s {6) = ^gU mjS (x* (0) , 0) . Then X* is the set of points 
on the graph of x* . We will call 9* = x* -1 the indifference index. 

Corollary 4.9. Suppose u m ^ is strictly supermodular and twice continuously differentiable. If 
tp mtS is Um^-subdifferentiable then the indifference index at x £ int(I m ) satisfies ip' ms {x) = 
^ r u m ^(x,0*(x)). Moreover, 0* is non- decreasing. 



4.4 Recovering consistent diffusions 

The following theorem provides necessary and sufficient conditions for a diffusion X m ' s to be 
the solution to the inverse stopping problem. 

Proposition 4.10. X m,s solves the inverse problem if and only if (p mtS and R m)S satisfy the 
following two conditions. 
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i) For all 9 G 6, Vm,s(^) = SU P [«m,s(^0) - Tp m , s (x)}, 

x£int(I m ), x>X 

H) ^ s (9) =log(V (8) - R m , s (X )). 

Proof. If X m ' s is consistent with V, G, Xq and one-sided stopping above Xq then 

log{V(e) - Rm,s{Xo)) = log(V Xm , a (9) - R(X^ S )) 

= sup [u m , s (x,9) - ip mtS (x)\ 

x£int(I m ), x>X 

= sup [u m>s (x, 9) - 1p m ,s( x )] 
x£int(I m ) 

= i>lM 

On the other hand, if the two conditions are satisfied then we can construct a diffusion X m ' s 
with starting point Xq. The first condition implies that one-sided stopping above Xq is optimal 
while the second condition ensures that Vx m ^ = V. □ 

It is intuitively clear that a value function contains information about the dynamics of a 
consistent diffusions above the starting point. If x > Xq, and the indifference index 9* is known 



then the solution to (2.3) must satisfy y?(x) = v(e*{x))-R(x ) • Thus if we can calculate R(Xq) 



and the indifference index for all x > Xq then we can calculate ip above the starting point. We 
can then recover pairs of scale functions and speed measures consistent with the solution above 



X through (2.3). 



On the other hand, for x < Xq, the only information we have is that U<yX ^J^^ does not 
attain a maximum below the starting point, otherwise V would not be consistent with one- 
sided stopping above Xq. Thus, while we may attempt to specify (unique) diffusion dynamics 
above Xq, we expect there to be a variety of consistent specifications of the diffusion dynamics 
below the starting point. This is analogous to the situation in Hobson and Ekstrom [12] where 
a unique consistent volatility co-efficient is derived below the starting point but there is freedom 
of choice above the starting point. The situation is similar in Alfonsi and Jourdain [I], where 
information about the underlying diffusion co-efficient can only be recovered either above or 
below the starting point, depending on whether perpetual American call or put option prices 
are given. 

The following two examples illustrate the ideas involved in recovering a consistent diffusion in 
the simplified setting when consistent diffusions are assumed to be either martingales (Example 



4.11) or in natural scale and with additional information about the early stopping reward 



(Example 4.12). 



Example 4.11. Let 9 = (0, ^jp] for some positive constant k. Suppose V(9) = (ra;) fe ^ri +1, 
G(x,9) = 9, c(x) = px and Xq = 1. Suppose the inverse problem is restricted to the class of 
diffusions that are also martingales. Then s(x) = x and R mjS (x) = x. We have u m ^{x,9) = 
log(# — x) and calculate rj^^x) = sup 6) [log(^ — x) — \og{V{9) — 1)] = \og{x~ k ), where the 
maximum is attained at 9*{x) = E^hll. To recover a consistent martingale diffusion on M + ; let 
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us extend the parameter space to Q = (0, oo) and set 9*(x) 



x(k+l) 



on (0,oo). Then we find 



that 4> m ,s(x) = x k on (0, 00) is a consistent eigenf unction. It follows that 



dX t = aX t dB t , X 

is consistent with V where a satisfies o 2 — — 

Example 4.12. Let 



1 



(fc+i/2)^T7i- 

l,oo). Recall the decomposition of the forward problem by the strong 
Markov property (3.1). Suppose we are given the optimal early stopping reward E{9) = e 6 * 2 / 2 



and the early stopping reward function U(x,9) = e and that Xq = 0. In this example, rj(9) = 
\og(E(9)) is known, so we suppress the subscripts m and s. We calculate supg[u(x,#) — r]{9)\ = 
x 2 /2 where the maximum is attained at 9*{x) = x. Let us suppose that s(x) = x and aim at 



recovering a (local) -martingale diffusion. On X*(Q) 

the diffusion is (p ms (x) = e 77 "^ = e 1 ' 2 / 2 . Solving for a in (2.4) we obtain o~(x) 



[l,oo) ; the candidate eigenf unction for 

— for 



1+x 2 



x G [l,oo). We can now specify a consistent diffusion by extrapolating the indifference index. 
Let = (0,oo) and set 9*(x 

r( x ) 



diffusion with dynamics 



x for < x < 1. By Proposition ^.7, Vm,s is u-convex on 

we find that the 



x. Thus by setting tp m ^{x) = e x I 2 for x G 



dX t = o{x)dB t + dL t , X Q = 0, a 2 



2p 



" 1 + x 2 ' 

where L is the local time at 0, is consistent with V . 

In general we can choose any increasing function 9* on [0, 1) with 9*(1— ) = 1 as long as the 
recovered function f> ms is an eigenfunction for a consistent diffusion. For instance, the choice 



-}l 2 for < x < 1 leads to (p r 



cxp 



E 3 / 2 

2 



for < x < 1. For this choice of 



extension and again setting s(x) = x, the consistent diffusion co-efficient is 



a 2 (x) 



32px 1 ^ 2 
6+9x 3 / 2 

1+x 2 




Note that for this extension <p' m s jumps at 1 and since 

we have m({l}) = (compare Example 1.4-3). Hence the increasing additive functional T u 
includes a multiple of the local time at 1 and the diffusion X m is 'sticky' at 1. 

For the general case, the main difficulty over the previous simplified examples of inverse 
problems is having to recover both a speed measure and a non-trivial scale function. This 
means that we must recover R m)S as well as (f m ,s to obtain two equations (2.3), (2.6) for the 
two unknown quantities. 



4.5 Recovering diffusions through a consistent indifference index 

Suppose that an indifference index 9* : I m — >• is consistent with a solution to the inverse 
problem, X m ' s . Then x * = 9*- 1 is the optimal threshold strategy for the corresponding forward 
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problem and by Proposition 3.7 



V'(0*(x)) 



Gq(x,0*(x)) 



(4.2) 



Lemma 4.13. If 0* is consistent with the inverse problem then all consistent diffusions X r 
satisfy 



E x 



poo 

/ e->*c(X?' a )dt 
Jo 



G(x,0*{x)) + <p mtS (x)(R m , s (X ) - V(0*(x))) 



for all x G int{I m ). 



Proof. By the definition of 0* , x G X*(0*(x)). It follows by ((372]) that 

V'(0*(x)) G e (x,0*(x)) 



V(0*(x)) - R m , s (X ) G{x,6*{x))-R m ,,(X ) 
for all x G X*(0). Combining this equation with ( |4.2[ ) we have 

fl m , s (x) = G(x,e*(x)) + ¥?m , fl (x)(i2 m , s (X )-y(r(x))). 



(4.3) 

□ 



Let R mtS (x) be the function on X*(@) defined Rm tS (x) = G(x,0*(x)) — (p m>s (x)V(0*(x)). 



Lemma 4.14. If R m}S (x) given by equation (4-3) solves (2.6) then so does R 



Proof. Follows from the fact that ip m ,s is a solution to the homogeneous equation (2.3). □ 



Given an inverse problem there will in general be many speed measures and scale functions 



satisfying the conditions in Proposition 4.10 Each solution corresponds to an optimal threshold 
strategy X* . By definition, choosing a consistent indifference index is equivalent to choosing 
a consistent threshold strategy. Thus, rather than searching over all solutions X m,s satisfying 



the conditions in Proposition 4.10, we can solve inverse problems by specifying a candidate 
indifference index. The following verification result provides a set of easily verifiable conditions 
for X m ' s to solve the inverse problem. 

Proposition 4.15. X m ' s is a solution to an inverse problem if the following conditions are 
satisfied. 

i) u m,s is strictly supermodular and twice continuously differentiate and(p m ^ s is differentiate 
almost everywhere, 

ii) there exists a monotone function x* : — > I m with inverse 0* such that C 0, x*{0) > 
Xq and such that whenever ip m , s is differ entiable 

d 

^ m , s {x) = —u m)S (x,0*(x)), 



Hi) rj m>s = ip^ iS . 
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Proof. By Proposition 4.7 and conditions i) and ii) tjj. 
Proposition |4.10 that Vx m > s = V. 



WtS is it TOS -convex. It follows from iii) and 

□ 



Theorem 4.16. A consistent indifference index determines a unique solution to the inverse 
problem on X*(Q). 

Proof. Suppose 9* is a consistent indifference index. Define / : X*(Q) — > R, f(x) = G y^f*^^ 
and g : X*(0) -> R, = G(x,9* (x)) - f (x)V (9* (x))) . By (Q, / = tp mi8 on X*(G) for a 
consistent diffusion X m,s , hence / is a solution to (|2.3|) on X*(#). Similarly by Lemma 4.14, g 



is a solution to (2.6) on X*(@). Solving the two equations for m and s we recover the (unique) 
dynamics of a consistent diffusion on X*(Q). □ 



0. 



and for a positive constant k, V{9) 



( ke 
U+i 



-2- -I- 1 
fc+1 ^ X > 



Example 4.17. Suppose 
Xq = 1, G(x, 9) = 9 and c(x) = jx where 7 is another positive constant. We define a family of 

_ x a (k+l) 
~ k 



indifference indices on (0, 1] parametrised by a > via 9* a {x 

We will calculate candidate diffusions using Proposition 4-15. By [4-2) we have that for 
x S X*(0) = (0, 1] a candidate solution to {2.J$ corresponding to the indifference index 9* a is 
(j) a ( x ) = x ~ ak . Similarly by (D we have R a {x) = x a +(p a (x)(R^ s (l)-l) and so R^ yS (x) = x a 
is a candidate solution to \2.(fy . Then, by equations (2.4) and \2.(ty , the corresponding consistent 
diffusion co-efficients on X*(0) = (0,1] are 



al(x) 

Pa{x) 



2(p(l + k)x 2 - kjx s - a ) 



[1 + ak) 



k(l + k)a 2 
px(l + A;) 



k"fX 



2-a 



k(l + k)a 2 



px 
ak 



Note that > on (0, 1] if and only if x 1 a < p ^f^ and hence for a consistent diffusion 

to exist on (0, 1] the problem parameters must satisfy a < 1 and p + k(p — 7) > 0. 
To specify a diffusion on (0, 00) consistent with a given a < 1 on (0, 1], we let 

e *( x ) = { e ^ x) *e **(€>) = 1 
\9t{x) X >1 J' 

The corresponding diffusion X a is given by 



dX? = a a {X t )dB t + fi a (X t )dt, X = 1 



where 



and 



2(p(l+k)x 2 -kjx 3 - a ) 

k(l+k)a' 2 
2(p(l+k)x 2 -ky) 
9k(l+k) 




p a (x) 



o<x<i 

/-. _|_ 9 1\ px(l+k) — k'yx 1 _ px -I 
V 1 6K ) 9fc(l+fc) 3k X > 1 
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The particular choice of 6* on (l,oo) is convenient because it ensures that the trivial condition 
> is satisfied for any choice of p, k and 7 satisfying p + k(p — 7) > 0. 
Since both boundary points are inaccessible we have R a = R a or equivalently R a (l) = 1. 
Note that if we set 7 = p and a = 1 then we recover Example \4-ll ■ 



Example 4.18. Suppose 6 = (1, 3), V{6) = 1 + |(V30 - y/0/S), G(x, 9) = Ox, c(x) = 1/x and 
Xq = 1. Furthermore suppose we are given 0*(x) = 3/x 2 forx e (0,oo). Then x*{9) = ^fifd 
and X*(Q) = (1, v3). By (4-2) we have (f m:S (x) = x 2 and R m>s (x) = 1/x + x 2 (R m ^ s (l) — 1) so 
that R m:S (x) = 1/x is a candidate solution to (4-3). The differential equations (2.3) and (2.6) 
lead to the following simultaneous equations. 

o~ 2 (x) + 2p(x)x 



o~ 2 (x) — xp(x) 



px 
px 2 



We calculate cr 2 (x) = xp{x) + px 2 — x 2 = px 2 — 2p{x)x so that p(x) = x/3 and a 2 (x) = 
x 2 (p — 2/3). R follows that we must have p > 2/3 for a solution to the inverse problem to exist. 



Provided this condition is satisfied, a solution to the inverse problem is 

dX t = ^Jp-*X t dB t + ^dt, X = l. 
Note that the solution to the inverse problem is uniquely specified on (1, \/3). 



5 Concluding remarks 

The main contribution of this article has been to provide a natural extension of the allocation 
(Gittins) index based on its role in solving forward and inverse stopping problems. In the 
context of the forward problem we showed that the idea of an allocation index can be extended 
naturally from the 'standard case' to a general class of optimal stopping problems and that 
there are natural conditions under which the index is monotone. Indeed, we found that this 
extension, which we have called the indifference index, is a natural feature of the monotone 
comparative statics of a family of forward problems. 

We showed that the indifference index parametrises solutions to inverse stopping problems. 
When an investment can be modelled as a perpetual horizon stopping problem, inverse stopping 
problems can be interpreted as inverse investment problems. In contrast to inverse Merton 
problems where we are given 1) a wealth process and 2) assume that the problem value arises 
from utility maximization in order to 3) compute consistent utility (gain) functions, in perpetual 
horizon inverse investment problems we are again given information about the problem value 
but are interested in recovering an investor's model for the underlying risky asset rather than 
the gain functions which are now given. In this context, the index has two natural economic 
interpretations. For the owner of an investment, the indifference index represents investor 
preferences with respect to liquidating for a terminal reward or remaining invested for a running 
reward and the option to liquidate later. For the potential investor, the index represents the 
parameter levels at which he is indifferent to the investment opportunity. 
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